United  States 
General  Aeroiinttng  Ofllce 
WashlnKton,  I>.C.  20548 

National  Scenrity  and 
International  AfTalrs  Division 

13-251430 

December  31, 1992 

The  Honorable  Howard  Wolpe 
Chairman,  Subcommittee  on 
Investigatioas  and  Oversight 
Committee  on  Science,  Space, 
and  Teclmology  ■ 

House  of  Representatives 

Dear  Mr.  Chainnan: 

Tills  report  responds  to  your  request  that  we  provide  information  on  the 
Natioaal  Aeronautics  and  Space  Administration’s  (nasa)  historical 
experience  at  estimating  space  program  costs.  Tlie  Subcommittee  was 
concerned  tliat  at  the  time  Congress  is  asked  to  authorize  the  start  of  new 
programs  estimated  to  cost  hundreds  of  millioas  or  even  billions  of 
dollars,  nasa  may  not  have  reasonably  accurate  estimates  of  their  total 
funding  requirements.  Specifically,  we  reviewed  Ihe  changes  from  initial  to 
current  estimates  for  mtijor  space  programs  initiated  in  the  past  15  years 
and  studied  the  reasons  for  those  changes. 


Results  in  Brief 


Almast  all  of  the  29  programs  we  reviewed  required  substantially  more 
funding  than  the  initial  estimates  provided  to  Congress.  Figure  1  shows  the 
extent  that  current  cost  estimates  changed  from  initial  estimates.  Changes 
in  estimates  ranged  from  a  44-percent  decrease  to  a  426-percent  increase 
over  the  initial  estimates.  The  median  change  was  a  77-percent  increase. 
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Rgure  1 :  Change*  From  initial  to 
Current  Coat  Eatimate*  for  29  NASA 
Space  Program* 


100%  increase  or  higher 


Under  initial  eatimate 


1-49%  increase 


50-99%  increase 


General  reasons  nasa  gave  for  differences  betw  een  the  initial  and  current 
estimates  included  insufficient  definition  studies,  program  and  funding 
instability,  overoptimism  by  program  officials,  and  unrealistic  contractor 
estimates.  Specific  reasons  for  changes  in  estimates  included  program 
redesigns,  technical  complexities,  budget  constraints,  incomplete 
estimates,  shuttle  launch  delays,  and  inflationary  effects.  As  a  result  of 
these  factors,  the  content  and  schedule  of  many  programs  changed 
substantially  between  the  initial  and  current  cost  estimates.  (See  apps.  11 
and  III.) 


Background 


Initial  cost  estimates  are  generated  during  nasa’s  phased  development 
process.  In  the  preliminary  analysis  phase,  proposed  mission  and  scientific 
objectives  are  outlined.  During  this  phase,  the  nasa  field  center 
responsible  for  the  project  identifies  technical  risks  and  prepares 
preliminary  cost  and  schedule  estimates.  A  more  detailed  cost  estimate  is 
developed  in  the  definition  phase  as  the  mission  is  better  defined.  In  this 
phase,  preliminary  designs,  specifications,  and  management  requirements 
are  developed.  Generally,  once  the  definition  phase  is  completed  and  the 
Administrator  of  nasa  approves  a  new  program,  it  is  included  in  the 
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Scope  and 
Methodology 


President’s  budget  and  submitted  to  Congress  for  aulhorization  to  start  the 
detailed  design  and  development  pluises.  At  this  time,  nasa  normally 
provides  Congress  with  an  initial  estimate  of  the  program’s  cost. 

Estimates  provided  to  Congress  by  nasa  typically  can  include  costs  for 
development,  mission  operations  and  data  analysis,  launch  services, 
tracking  services,  and  construction  of  program-unique  facilities.  After  a 
program  is  authorized  to  begin  the  detailed  design  and  development 
phases,  nasa  provides  Congress  with  updated  information  on  programs 
through  Project  Status  Reports.  Tltese  biannual  reports  document  the 
initial  estimates  and  track  the  costs,  schedules,  perfonnance,  and  progress 
of  NASA’s  mayor  programs. 

Developing  estimates  in  the  preliminary  analysis  and  definition  phases  is 
difficult  because  there  is  often  a  great  deal  of  uncertainty  involved. 

Margins  for  uncertainties  are  built  into  the  estimates  in  the  form  of 
reserves  so  that  a  program’s  budget  better  reflects  potential  resource 
needs.  Reserves  are  established  to  fund  significant  changes  in  the 
definition  or  scope  of  the  project,  new  requirements,  engineering  changes, 
schedule  slips,  increases  in  technical  or  management  complexity,  and 
known  issues  whose  cost  impact  is  uncertain.  The  level  of  reserves  varies 
from  program  to  program  and  depends  on  the  level  of  uncertainty  and  risk 
of  the  particular  program,  nasa  considers  a  reasonable  level  of  reserves  to 
range  from  10  to  35  percent  of  a  program’s  development  budget. 


To  determine  nasa’s  historical  experience  at  providing  Congress  with 
accurate  estimates  when  new  program  starts  were  requested,  we 
compared  the  initial  estimates  provided  to  Congress  with  the  current 
estimates  for  space  programs  that  (1)  were  initiated  between  1977  and 
1991  and  (2)  had  initial  or  current  estimated  development  costs  greater 
than  $200  million — the  threshold  established  for  reporting  programs  to 
Congress  through  Project  Status  Reports.  We  identified  29  such  programs, 
including  planetary  missions,  space  and  earth  science  missions,  manned 
missions  and  related  programs,  and  other  programs  such  as 
commuiucations  satellites.  We  did  not  review  the  National  Launch  System 
or  National  Aerospace  Plane  programs  because  nasa  was  not  the  principal 
agency  funding  and  managing  these  programs.  We  also  excluded  from  our 
analysis  costs  for  program  elements  provided  by  offier  federal  agencies  or 
international  partners.  Initial  estimates  reflect  Uie  projected  costs  at  the 
time  a  new  program  was  first  authorized  by  Congress.  Current  estimates 
reflect  the  latest  estimate  as  of  nasa’s  fiscal  year  1993  budget  request  for 
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programs  that  were  in  development  or  launched,  or  Uie  latest  estimate 
prior  to  the  decision  to  cancel  programs.  As  agreed  with  nasa,  we 
consistently  used  the  highest  estimates  in  our  analysis  where  estimates 
were  presented  as  ranges. 

To  determine  the  reasons  for  changes  in  the  estimates,  we  collected 
information  from  nasa  on  each  of  the  29  programs,  reviewed  the  Project 
Status  Reports,  and  interviewed  current  and  former  officials  at  nasa 
headquarters,  the  Goddard  Space  Flight  Center,  the  George  C.  Marshall 
Space  Flight  Center,  and  the  Jet  Propulsion  Laboratory.  In  addition,  we 
reviewed  our  prior  reports  on  1 1  of  the  programs.  For  the  purpose  of 
analyzing  specific  reasons  for  estimate  changes,  we  judged  a  reason  to  be 
significant  if  it  was  related  to  a  change  estimated  to  cost  at  least 
$20  million — 10  percent  of  the  minimum  cost  for  programs  tracked  in  the 
Project  Status  Reports.  To  determine  inflationary  effects,  we  used  nasa's 
inflation  index  to  compare  the  initial  and  current  cost  estimates  for  the 
development  portion  of  the  program  budget  in  fiscal  year  1992  constant 
dollars. 

As  requested,  we  did  not  obtain  official  agency  comments  on  this  report. 
However,  we  discussed  a  draft  of  the  report  with  officials  from  nasa’s 
Office  of  the  Comptroller  and  considered  their  comments  in  preparing  the 
firud  report,  nasa  officials  generally  agreed  with  the  facts  in  the  report,  but 
were  concerned  that  readers  not  simply  review  the  amounts  of  estimate 
changes  without  fully  considering  the  reasons  for  the  changes  that  are 
presented  in  the  report.  We  conducted  our  work  from  F  ebruary  to 
November  1992  in  accordance  with  generally  accepted  government 
auditing  standards. 


Unless  you  publicly  announce  its  contents  earlier,  we  plan  no  further 
distribution  of  this  report  until  30  days  from  the  date  of  this  letter.  At  that 
time,  we  will  send  copies  to  intereste'i  parties  upon  request. 
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Please  contact  me  on  (202)  275-5140  if  you  or  your  staff  have  any 
questions  concerning  this  report.  Other  m^or  contributors  to  this  report 
are  listed  in  appendix  IV. 

Sincerely  yours, 

Mark  E.  Gebicke 
Director,  .nasa  Issues 
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1  Abbreviations 

ACTS 

Advanced  Communications  Technology  Satellite 

AFE 

Aeroassist  Flight  Experiment 

ASRM 

Advanced  Solid  Rocket  Motor 

ATP 

Alternate  Turbopumps 

AXAF 

Advanced  X-ray  Astrophysics  Facility 

COSTR 

Collaborative  Solar  Terrestrial  Research 

CEiAF 

Comet  Rendezvous  Asteroid  Flyby 

EOS 

Earth  Observing  System 

EUVE 

EIxtreme  Ultraviolet  Explorer 

FTS 

Flight  Telerobotic  Servicer 

GAO 

General  Accounting  Office 

GGS 

Global  Geospace  Science 

GOES 

Geostationary  Operational  Environmental  Satellite 

GRO 

Gamma  Ray  Observatory 

HST 

Hubble  Space  Telescope 

LANDSAT 

Land  Remote  Sensing  Satellite 

NASA 

National  Aeronautics  and  Space  Administration 

NSCAT 

NASA  Scatterometer 

OMV 

Orbital  Maneuvering  Vehicle 

SOHO 

Solar  and  Heliospheric  Observatory 

TORS 

Tracking  and  Data  Relay  Satellite 

TOPEX 

Ocean  Topography  Experiment 

TRMM 

Tropical  Rainfall  Measuring  Mission 

TSS 

Tethered  Satellite  System 

CARS 

Upper  Atmosphere  Research  Satellite 

XTE 

X-ray  Timing  Explorer 
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Changes  in  the  Total  Estimated  Cost  of  29 
NASA  Space  Programs 


The  total  estimated  cost  for  most  space  programs  we  reviewed  changed 
significantly  between  the  initial  estimates  provided  to  Congress  and  the 
current  estimates.  Table  1. 1  presents  the  changes  in  the  National 
Aeronautics  and  Space  Administration  (nasa)  estimates  in  then-year 
dollars  and  the  status  of  the  29  programs.' 


Table  1.1:  InKial  and  Current  Program  Cost  Estimates 

Then-year  dollars  in  millions 

Program 

Inhial 

estimate 

Current 

estimate 

Dollar 

change 

Percent 

change 

Status 

Tethered  Satellite  System  (TSS) 

50 

263 

213 

426 

Launched 

X-ray  Timing  Explorer  (XTE) 

100 

373 

273 

273 

Development 

Galileo  (Mission  to  Jupiter) 

455 

1,639 

1,184 

260 

Launched 

Advanced  X-ray  Astrophysics  Facility  (AXAF)^ 

2,050 

6.022 

3,972 

194 

Development 

Alternate  Turbopumps  (ATP) 

372 

1,053 

681 

183 

Development 

Hubble  Space  Telescope  (HST)^ 

617 

1,682 

1,065 

172 

Launched 

Extreme  Ultraviolet  Explorer  (EUVE) 

120 

168 

Launched 

Geostationary  Operational  Environmental  Satellite 
(GOES)  l-M' 

691 

1,787 

1,096 

159 

Development 

Aeroassist  Flight  Experiment  (AFE)'' 

159 

387 

228 

143 

Canceled 

Gamma  Ray  Observatory  (GRO) 

317 

677 

360 

114 

Launched 

Advanced  Solid  Rocket  Motor  (ASRM)® 

1,699 

3,250 

1,551 

91 

Development 

NASA  Scatlerometer  (NSCAT) 

135 

255 

120 

89 

Development 

Mars  Observer  (Mission  to  Mars) 

536 

994 

458 

85 

Launched 

Orbital  Maneuvering  Vehicle  (OMV)'' 

440 

814 

374 

85 

Canceled 

Tracking  and  Data  Relay  Satellite  replacement  (TDRS-7) 

300 

532 

232 

77 

Development 

Land  Remote  Sensing  Satellite  (LANDSAT-D) 

311 

538 

227 

73 

Launched 

Collaborative  Solar  Terrestrial  Research  (COSTR) 

400 

673 

273 

68 

Development 

Tropical  Rainfall  Measuring  Mission  (TRMM) 

290 

468 

178 

61 

Development 

Ulysses  (Mission  to  the  Sun) 

292 

168 

58 

Launched 

Magellan  (Mission  to  Venus) 

556 

856 

300 

54 

Launched 

Right  Telerobotic  Servicer  (FTS)"* 

317 

485 

168 

53 

Canceled 

Advanced  Communications  Technology  Satellite  (ACTS) 

496 

656 

160 

32 

Development 

Ocean  Topography  Experiment  (TOPEX) 

438 

520 

82 

19 

Launched 

Freedom  (Space  Station)' 

25.120 

28,935 

3,815 

15 

Development 

Global  Geospace  Science  (GGS) 

568 

649 

81 

14 

Development 

(continued) 

'Then-year  dollars  rcOect  the  estimated  piirrha.sing  power  of  the  dollar  in  tite  year  that  an  exitendilure 
will  occur.  These  estimates  arc  a<ljusle<l  for  projected  inflatif)n  It)  show  Congress  and  otln-rs  the 
amounts  that  may  have  to  be  appropriated  to  complete  a  program.  In  NA.SA's  fTojerl  .Status  Ke|)orl.s, 
these  inflation^tscalaled  amounts  are  referred  to  as  real-year  tiollars. 
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Changes  in  the  Total  Estimated  Cost  of  29 
NASA  Space  Programs 


Then-year  dollars  in  millions 

Program 

Initial 

estimate 

Current 

estimate 

Dollar 

change 

Percent 

change 

Status 

Upper  Atmosphere  Research  Satellite  (UARS) 

814 

790 

-24 

-3 

Launched 

Comet  Rendezvous  Asteroid  Flyby  (CRAF)/  Cassini 
(Mission  to  Saturn)® 

3,593 

3,351 

-242 

-7 

Canceled/ 

Deveiopmen: 

Endeavour  (Space  Shuttle) 

2,100 

1,800 

-300 

-14 

Launched 

Earth  Observing  System  (EOS)®-® 

21,085 

11,744 

-9,341 

-44 

Development 

Note:  Estimates  are  current  as  jf  NASA's  fiscal  year  1993  budget  request.  Estimates  may  include 
costs  for  development,  implementation,  operations,  data  analysis,  launch  and  tracking  services, 
and  construction  of  facilities  through  the  end  of  the  program,  NASA  estimates  do  not  include  civil 
service  personnel  costs, 

“AXAF,  Cassini,  and  EOS  programs  were  being  reevaluated  by  NASA  at  the  time  of  our  field  work 
The  cost,  schedule,  and  content  of  these  programs  may  change  significan'Iy,  For  example, 
subsequent  to  NASA's  fiscal  yea'  1993  budget  request,  development  and  operations  funding  for 
EOS  was  capped  at  $8  billion— $3  billion  less  than  the  amount  included  in  the  table's  current 
estimate. 

•“HST  estimates  do  not  include  costs  for  mission  operations  and  data  analysis. 

■^GOES  l-M  estimates  include  costs  for  development  and  launch  services  NASA  manages  the 
development  and  launch  of  the  GOES  weather  satellites  for  the  Department  of  Commerce. 
Commerce  performs  the  mission  operations,  data  analysis,  and  tracking  services  for  operational 
weather  satellites. 

“Current  estimates  for  AFE,  OMV,  and  FTS  were  the  latest  prior  to  cancellation, 

'The  initial  ASRM  estimate  includes  costs  for  design,  development,  test,  and  evaluation  The 
current  estimate  also  includes  costs  for  the  first  six  pairs  of  production  rocket  motors  that  NASA 
decided  to  include  in  the  development  program.  The  cost  of  additional  production  units  is  not 
included  in  the  estimates. 

The  initial  estimate  for  space  station  Freedom  reflects  the  estimated  costs  in  NASA's  fiscal  year 
1988  budget  request  at  the  time  the  program  began  the  detailed  design  and  development 
phases,  consistent  with  the  timing  of  the  other  initial  program  estimates  in  the  table,  NASA 
provided  an  initial  estimate  of  $1 1  billion  ($8  billion  in  1984  dollars)  to  Congress  in  1 984  prior  to 
completing  the  definition  phase.  The  Freedom  estimates  only  include  costs  for  development, 
operations,  launch  and  tracking  services,  and  construction  of  facilities  through  fiscal  year  1999. 
Other  costs  in  the  space  station  capital  development  plan,  such  as  civil  service  personnel  and 
definition  were  excluded  because  these  cost  are  not  included  in  the  other  NASA  program 
estimates.  NASA  has  estimated  that  it  will  cost  about  $2  billion  or  more  annually  to  operate  the 
space  station  between  2000  and  2027.  In  our  testimony,  Questions  Remain  on  the  Costs,  Uses. 
and  Risks  of  the  Redesigned  Space  Station  (GAO/T-NSIAD-91-26,  May  1 ,'  1991),  we  summarized 
our  reasons  for  concluding  that  NASA's  space  station  cost  estimates  were  understated 

“EOS  estimates  only  include  costs  through  fiscal  year  2000.  The  last  satellite  In  the  EOS  program 
is  scheduled  for  launch  in  2012. 


Estimates  increased  for  25  of  the  29  programs.  Increases  ranged  from  14  to 
426  percent  above  initial  estimates.  These  incre?.ses  were  above  the 
reserves  already  included  in  the  initial  estimates  to  fund  typical  changes, 
problems,  and  delays.  Decreases  in  estimates  for  the  other  four  programs 
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Changes  in  the  Total  Eadmated  Cxtut  of  29 
NASA  Space  Programs 


ranged  from  3  to  44  percent  under  the  initial  estimates.  The  median 
estimate  change  for  all  programs  was  an  increase  of  77  percent.^  Estimates 
for  nearly  three-quarters  of  the  programs  increased  by  more  than 
50  percent,  and  one-third  increased  by  more  than  100  percent.  Similar 
trends  can  be  seen  when  only  launched  programs  are  considered.  These 
programs  provide  a  more  complete  picture  of  changes  in  estimates 
because  their  actual  costs  through  launch  are  known  and  mission 
operations  and  data  analysis  costs  are  either  known  or  can  be  better 
estimated.  Of  the  12  programs  that  were  launched,  current  cost  estimates 
ranged  from  14  percent  under  the  initial  estimate  to  426  percent  over,  with 
a  median  increase  of  79  percent. 

Estimates  for  four  programs  decreased  over  time,  eos  and  CRAF/Cassini 
estimates  decreased  as  a  result  of  m^or  reductions  in  program  content  in 
response  to  funding  limitations.  The  other  two  programs,  uars  and 
Endeavour,  stand  out  as  programs  that  were  successfully  completed 
within  their  initial  cost  estimates,  uars  program  officials  gave  several 
reasons  why  the  program  was  completed  for  slightly  less  than  its  initial 
cost  estimate.  F*rst,  they  believed  that  uars  benefited  from  an  experienced 
management  team  that  had  worked  together  on  other  programs.  Second, 
extensive  definition  studies  were  performed,  allowing  for  thorough 
understanding  of  requirements  and  eariy  identification  of  risks.  Third,  uars 
used  an  existing  spacecraft  design  that  reduced  uncertainties  for  the 
spacecraft  development  and  for  the  instruments  that  could  be  designed  to 
a  kncwn  interface.  Finally,  uars  officials  said  that  stable  funding 
contributed  to  the  program's  success. 

According  to  nasa  officials.  Endeavour  successfully  met  its  initial  cost  and 
schedule  estimates  primarily  because  the  contractor  had  prior  experience 
building  space  shuttles.  Fiirthermore,  Endeavour  was  a  production  rather 
than  a  research  program,  which  reduced  the  level  of  risk  involved.  Like 
uars,  the  project  team  was  also  experienced,  and  the  processes  involved  in 
producing  the  shuttle  were  well  established.  Finally,  the  fact  that  Congress 
appropriated  all  of  the  needed  funding  before  the  Endeavour  production 
contract  was  awarded  contributed  to  the  program’s  stability. 


^A  median  us  the  middle  value  in  a  set  of  ordercil  values,  where  half  the  values  lie  above  the  median, 
and  half  below.  Due  to  the  diversity  of  tlic  cost  tlata  we  reviewed,  we  believed  that  a  median  was  a 
more  appropriate  mea-sure  of  central  tendency  than  an  average. 
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Reasons  for  the  Changes  in  Cost  Estimates 
for  Major  Space  Programs 


NASA  officials  identified  both  general  aiid  specific  reasons  why  initial 
estimates  provided  to  Congress  changed  over  time.  According  to  these 
officials,  general  reasons  for  the  initial  estimates’  being  far  lower  than  tlie 
eventual  cost  of  the  programs  included  insufficient  definition  studies, 
program  and  funding  instability,  overly  t,  Limistic  assumptions  by  program 
officials,  and  unrealistic  contractor  estimates.  Based  on  infonnation 
provided  by  nasa  and  our  prior  reports,  we  organized  the  specific  reasons 
for  the  estimate  changes  in  the  29  programs  into  6  categories:  program 
redesigrvs,  technical  complexities,  budget  coastraints,  incomplete 
estimates,  shuttle  launch  delays,  and  inflationary  effects.  Thtse  factors 
often  resulted  in  programs  whose  content  and  schedules  changed 
substantially  between  the  initial  and  current  cost  estimates. 


General  Reasons  for 
Changes  Between 
Initial  and  Current 
Estimates 


Tw'o  NASA  studies,  conducted  over  a  decade  apart,  empliasized  the 
importance  of  thorough  definition  studies.  The  first,  .nasa’s  Project 
Management  Study  in  1980,  concluded  tliat  one  of  the  most  significant 
contributors  to  cost  and  schedule  growth  was  inadequate  definition  of 
technical  and  management  aspects  of  a  program  prior  to  sasa's  seeking 
approval  to  proceed  from  the  Office  of  Management  and  Budget  and  the 
Congress.  Tlie  study  recommended  that  sufficient  funding  be  included  in 
NASA  budgets  for  thorough  definition  studies.  The  second  study,  nasa’s 
Roles  and  Missions  Report  in  1991,  documented  tlie  need  for  increased 
emphasis  on  technological  readiness  and  requirements  on  tlie  front  end  of 
a  program.  In  response  to  this  report,  the  nasa  Administrator  directed  the 
agency  to  implement  more  rigorous  definition  studies.  The  purpose  of  the 
studies  was  to  understand  the  full  range  and  implications  of  a  program’s 
technical  content  in  order  to  prepaure  an  implementation  plan  that  includes 
the  cost,  schedule,  and  performance  contingencies  necessary  to  make 
meaningful  and  reliable  internal  and  external  commitments. 

NASA  officials  cited  program  and  funding  instability  as  another  general 
reason  for  changing  estimates.  Space  programs  can  take  a  decade  or  more 
to  complete,  often  spanning  changes  in  nasa  management,  presidents,  and 
Congress,  nasa  officials  stressed  the  difficulties  in  efficiently  managing 
long-term  programs  in  an  environment  where  funding  must  be  approved  in 
an  annual  budget  process  and  priorities  can  change  or  compete.  Changing 
and  competing  priorities  can  result  in  unstable  and  inefficient  funding 
profiles.  ’The  Advisory  Committee  on  the  Future  of  tlie  U.S.  Space  Program 
also  raised  concerns  about  program  and  funding  stability.  The  Advisory 
Committee’s  December  1990  report  cited  the  lack  of  coasensus  on  goals 
and  management  turbulence  as  general  concerns  about  the  Nation’s  space 
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program.  The  Advisory  Committee  further  slated  that  Congress  should 
provide  program  stability  through  consistent  and  adeqmite  fimding 

NASA  officials  also  cited  overopiimlsm  as  a  reason  why  initial  estimates  are 
often  significantly  lower  tltai^  current  estimates.  According  to  a  fonner 
deputy  administrator,  optimism  provides  tlie  “can  do"  attitude  tlxat  enables 
scientists  and  engineers  to  meet  tlie  ctiallenges  and  solve  tlte  unknowas 
intrinsic  to  nasa's  work.  However,  if  this  optimism  is  not  tempered  by 
realism,  it  can  load  tlie  program  team  to  underestimate  technical 
challenges  and  ov'erestimate  its  capabilities  to  solve  them,  nasa’s  1980 
Project  Management  Study  noted  tliat  nasa  should  be  realistic  with  itself, 
Congress,  and  the  public  in  terms  of  the  goals,  capabilities,  costs, 
schedule,  and  technical  risks  of  a  new  project.  More  recently,  the  Advisory 
Committee  on  the  Future  of  the  U.S.  Space  Program  also  concluded  that 
NASA  must  be  more  realistic  in  estimating  the  resources  that  will  be  needed 
to  complete  programs. 

NASA  officials  stated  tliat  unrealistic  contractor  proposals  and  estimates 
also  contribute  to  differences  in  initial  and  current  estimates.  According  to 
these  officials,  competition  drives  proposal  costs  down  and  creates 
artificially  low  estimates.  Tliese  proposals  tend  to  be  optimistic  in 
assessing  the  actual  complexity  and  cost  of  developing  new  technology. 
NASA  recently  rejected  contractors'  cost  estimates  for  tlie  development  of 
the  EOS  data  and  information  system  because  they  were  considered 
unrealistically  low.  A  senior  nasa  official  stated  that  by  rejecting  the 
proposals,  nasa  was  sending  a  message  to  contractors  that  there  is  a  new' 
way  of  doing  business  at  nasa  and  tliat  the  agency  will  no  longer  tolerate 
“low  balling."  In  tlie  official’s  opinion,  contractor  low  balling  of  proposal 
estimates  to  buy  into  programs  has  been  a  costly  problem  for  the  agency. 


Specific  Reasons  for 
Estimate  Changes 


Table  II.  1  summarizes  the  m^or  reasons  for  changes  in  the  estimates  for 
the  29  programs  we  reviewed.  The  table  illustrates  the  reasons  that 
increased  or  decreased  a  program  estimate  by  at  least  $20  million  when 
the  dollar  impact  of  the  reason  could  be  deU  rmined.  In  cases  where 
multiple  events  within  a  reason  category  sometimes  increased  the 
estimate  and  other  times  decreased  it,  the  table  indicates  whether  the 
predominant  change  was  an  increase  or  a  decrease. 

The  reasoas  for  estimate  changes  were  often  interrelated.  Consequently, 
the  impact  of  one  event  may  be  indicated  in  several  categories.  For 
example,  if  budget  cuts  were  handled  by  reducing  program  content,  a 
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minus  sign  would  appear  in  tlie  program  redesign  category  to  indicate  tliat 
the  estimate  decreased  along  with  the  program  content.  If  sasa  liandJed 
the  budget  cuts  by  stretching  out  the  program  over  a  longer  period,  a  plas 
sign  would  appear  in  the  budget  constraint  category  to  indicate  ttiat  total 
estimated  program  costs  increased  if  additional  costs  were  incurred  by 
contractors  as  a  result  of  delays.  Depending  on  tfie  lengUi  of  the 
stretch-out  and  the  amount  of  funding  shifted  to  future  years,  a  plus  sign 
might  also  appear  in  the  inflationary  effect  category  to  indicate  llrat  the 
estimate  also  increased  as  a  result  of  inflation.  Each  category  is  discussed 
in  more  detail  in  table  11.1. 
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Table  11.1:  Reasons  for  Changes  in  Cost  Estinurtes 

Program 

Technical 

Budget 

Incorr^lete 

Shuttle 

inflationary 

Program 

redeaign* 

complexity 

constraint 

estimate 

delay** 

effect® 

TSS 

4 

4 

4 

XTE 

♦ 

4 

Galileo 

■f 

4 

4 

4 

AXAF 

■f 

4 

4 

4 

4 

ATP 

+ 

4 

4 

HST 

4 

4 

4 

4 

EUVE 

♦ 

4 

GOES  l-M 

4 

4 

4 

AFE 

4 

4 

4 

GRO 

4 

4 

4 

4 

ASRM 

4 

4 

4 

4 

NSCAT 

4 

4 

Mars  Observer 

4 

4 

4 

4 

♦ 

OMV 

4 

4 

4 

TDRS-7 

4 

4 

4 

LANDSAT-D 

4 

4 

4 

COSTR 

4 

TRMM 

4 

4 

Ulysses 

4 

4 

4 

Magellan 

4 

4 

4 

FTS 

_ 

4 

4 

4 

ACTS 

4 

4 

4 

4 

TOPEX 

4 

Freedom 

4 

4 

4 

GGS 

4 

UARS 

4 

CRAF/CassinI 

_ 

4 

4 

4 

Endeavour 

EOS 

4 

•A  plus  sign  (+)  means  increased  cost  estimate  A  minus  sign  (■)  means  decreased  cost  estimate 


'’Shuttle  delays  largely  resulted  from  the  Challenger  accident  and  its  effects  on  the  space  shuttle 
program. 

'’The  inflationary  effect  was  calculated  on  development  costs  only  It  represents  the  sum  of  the 
inflation  on  the  initial  estimate  and  the  program  changes 
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Program  Redesign 


Program  redesign  involves  significant  changes  in  requirements,  spacecraft, 
instruments,  launch  vehicles,  upper  stage  propulsion  systems,  trsyectories, 
or  operations.  According  to  nasa’s  records,  16  estimates  increased  and 
6  decreased  as  a  result  of  m^or  program  redesigns. 

XTE  is  an  example  where  the  estimated  cost  was  driven  up  by  adding  new 
requirements  to  the  program,  xte  was  originally  designed  to  replace  el’ve 
on  the  explorer  platform  during  a  space  shuttle  mission.  However,  funding 
problems  led  to  delays  that  would  have  meant  the  mission  to  replace  euve 
with  XTE  would  not  have  occurred  until  the  explorer  platform  was 
significantly  older,  increasing  the  risk  to  the  xte  program.  To  avoid  the 
delay,  nasa  added  requirements  for  a  dedicated  platform  to  the  program  to 
be  launched  by  an  expendable  launch  vehicle,  increasing  development 
cost  estimates  by  over  $100  million. 

Program  redesign  may  also  result  when  programs  are  restructured 
because  of  funding,  technical,  or  schedule  problems.  For  example,  the 
cost  estimate  for  the  eos  program  decreased  when  the  program  was 
restructured  in  response  to  directions  from  the  Senate  Committee  on 
Appropriations.  The  Committee’s  report  accompanying  nasa’s  fiscal  year 
1992  appropriations  bill  directed  nasa  to  reduce  spending  on  the  program 
by  about  $5  billion  through  the  year  2000.  To  reduce  the  program’s 
development  and  operations  budget  firom  $16  billion  to  $1 1  billion,  and  the 
total  cost  to  $11.7  billion,  nasa  changed  the  number  and  type  of  satellites, 
reduced  the  number  of  instruments,  and  delayed  the  launch  of  some 
satellites.  Further  changes  in  the  program  and  estimate  will  occur  as  nasa 
responds  to  directions  in  the  Committee’s  fiscal  year  1993  report  to  cap 
development  and  operations  spending  at  $8  billion  through  2000. 

The  Challenger  accident  also  caused  program  redesigns  that  changed 
estimates.  Some  program  estimates  changed  because  transportation  for 
the  spacecraft  switched  from  the  shuttle  to  expendable  launch  vehicles. 
Others  were  affected  by  a  safety  decision  to  replace  the  liquid-fueled 
upper  stage  propulsion  system  with  a  solid-fueled  system.  For  example, 
the  Challenger  accident  and  related  upper  stage  change  increased  Galileo’s 
cost  estimates  by  about  $480  million  because  of  changes  in  both  hardware 
and  mission  design.  Among  the  required  changes  were  (1)  programming  a 
longer  trsyectory  to  Jupiter  because  of  the  cliaitge  to  a  less  powerful  upper 
stage,  (2)  replacing  aging  components,  and  (3)  designing  and  developing 
thermal  protection  for  the  spacecraft  because  of  longer  exposure  to 
radiation.  Because  the  less  powerful  upper  stage  required  a  longer 
trsgectory,  mission  times  lengthened  and  operations  costs  increased. 
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Technical  Complexity  Technical  complexities  inherent  in  the  nature  of  nasa’s  work  resulted  in 

increases  in  many  program  estimates,  .nasa's  work  is  highly  experimental, 
often  involving  uitique  missions,  long  time  frames,  and  technology  that 
pushes  the  state  of  the  art.  In  some  cases,  na-sa  or  its  contractors 
underestimated  the  technical  challenges  on  a  program.  Technical 
complexities  also  arose  from  design  problems  or  difficulties  in  the 
fabrication  process.  In  other  cases,  technical  problems  were  tlie  result  of 
poor  contractor  performance.  These  problems  increased  costs  by  causing 
additiorral  design,  development,  fabrication,  and  testing.  Accordirtg  to 
NASA,  techrrical  problems  increased  estimates  for  16  of  the  29  programs. 

GOES  I-M  is  an  example  of  a  program  that  experienced  technical  problems 
during  development  due  to  the  complexity  of  the  satellite  design  and  poor 
contractor  performance,  nasa  and  the  contractor  underestimated  the 
design  complexities  inherent  in  the  requirements  for  a  precisely  controlled 
satellite  capable  of  accurately  pointing  instruments.  Technical  problems 
were  compounded  by  nasa’s  poor  technical  management  of  the  program 
and  its  contractors.  ’The  inexperience  of  the  instrument  subcontractor’s 
staff  and  the  lack  of  technical  guidance  by  the  prime  contractor  also 
contributed  to  the  significant  problems  and  delays  in  the  program. 


Budget  Constraints  Program  cost  estimates  were  affected  when  programs  did  not  receive  the 

level  of  funding  requested.  Budget  constraints  on  particular  programs 
were  internally  imposed  by  nasa  or  externally  directed  by  the  Office  of 
Management  and  Budget  or  Congress.  To  offset  near-term  budget 
shortfalls,  programs  were  often  stretched  out,  pushing  more  of  the  funding 
requirements  into  the  future  and  resulting  in  higher  total  costs,  nasa 
officials  attributed  these  higher  costs  in  part  to  additional  expenses 
incurred  by  contractors  over  the  longer  period.  According  to  nasa,  budget 
constraints  significantly  increased  estimates  for  12  of  the  29  programs. 

The  AXAF  program  was  a  case  where  both  internal  and  external  budget 
constraints  impacted  program  estimates.  To  provide  funding  for  the 
Hubble  Space  Telescope  and  other  projects,  nasa  cut  the  axaf  budget  by 
about  $25  million  and  $75  million  in  fiscal  years  1991  and  1992, 
respectively.  'These  cuts  caused  cost  increases  of  about  $90  million 
because  the  program  had  to  be  rephased.  After  rephasing.  Congress 
reduced  fiscal  year  1992  development  funding  by  $60  million  and 
significantly  reduced  funding  for  fiscal  year  1993.  These  latter  budget  cuts 
delayed  the  launch  from  early  1998  to  mid-1999.  The  resulting  stretch-out 
increased  estimated  ftiture  years’  development  costs  by  over  $200  million. 
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Incomplete  Estimates  Changes  between  initial  and  current  estimates  were  caused,  m  p;ul. 

NASA  not  including  all  costs  in  its  inititil  program  i*stimat<'s.  Acconimg  io 
NASA  documents,  1 1  of  the  29  inituil  prognun  estimates  lacked  c{ist 
information  on  such  elements  as  launch  services  (ir  mission  tiperaiions 
and  data  analysis.  Excluding  some  costs  from  the  initial  program  estimati  s 
meant  that  more  complete  estimates  of  total  costs  were  not  available  to 
Congress  when  it  authorized  the  prognun.  According  officials, 

some  costs  may  have  been  excluded  from  initial  jirognun  estirnati's 
because  they  were  accounted  for  in  separate  budget  categories,  n.vs a 
officials  also  stated  tliat  although  the  initial  prognun  eslinuites  ma>  nut 
have  included  all  costs,  congressional  committees  may  have  been 
informed  of  those  otlier  costs  through  hefu-ings  ;uid  other  matm  iai  that 
NASA  prepared  in  support  of  its  budget  requests. 

In  most  cases,  excluding  some  costs  from  initial  estimates  diil  not  have 
any  significant  near-term  budgetary  impact.  Most  launch,  mission 
operations  and  data  analysis,  and  tracking  funds  are  budgeted  in  years 
following  the  fiscal  year  in  which  a  program  is  initially  approved. 

However,  initially  excluding  certain  costs  dramatically  ch.uiged  sonu*  total 
program  estimates.  For  example,  the  estimate  for  15  years  of  operations 
and  servicing  costs  for  axap'  was  not  included  in  estimates  until 
March  1992,  even  though  the  program  was  approved  for  a  new  start  in 
fiscal  year  1989.  The  additional  costs  increased  the  total  program  estimate 
by  $3.2  billion. 


Shuttle  Delays  Elstimates  increased  as  program  schedules  stretched  out  due  to  launch 

delays.  Table  III.l  in  appendix  III  shows  that  the  launch  date  slipped  for 
almost  every  program.  However,  according  to  nasa,  only  9  of  the  29 
programs  were  significantly  delayed  due  to  launch  vehicle  problems;  the 
others  were  delayed  because  of  program  redesigns,  technic;il 
complexities,  or  funding  constraints.  All  nine  of  these  prognuns  were 
ciffected  by  the  Challenger  accident  in  Janiuuy  1986  and  other  shuttle 
problems.  The  accident  caused  some  missions  to  be  delayed  by  st!veral 
years.  For  example,  nasa  estimated  that  the  Challenger  accident  ;md  other 
shuttle  problems  delayed  the  Hubble  Space  Telescope’s  launch  by  about 
4  years  and  increased  program  costs  by  over  $300  million. 


Inflationary  Effects  inflation  also  increased  cost  estimates  as  progrmn  schedules  were 

stretched  out.  Inflation  affected  program  cost  estimates  to  varying 
degrees,  depending  on  the  amount  of  funding  shifted  to  future  years.  tiH‘ 
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numb€r  of  years  funding  was  shifted,  and  the  estimated  rate  of  inflation. 
The  inflationary  effect  category  in  table  II.  1  represents  the  change  in  the 
estimated  development  costs  due  to  the  effects  of  inflation  on  both  the 
initial  estimate  and  on  costs  added  to  the  development  effort  a^ter  the 
irutial  estimate.  Estimates  for  the  development  cost  of  16  of  the  29 
programs  increased  by  more  than  $20  million  as  a  result  of  inflationary 
effects. 

We  analyzed  irdlationary  effects  only  on  the  development  portion  of  the 
program  estimate  because  sufficient  information  was  not  available  for  the 
other  cost  elements,  particularly  on  nasa’s  older  programs,  to  reconstruct 
complete  initial  funding  plans.  The  development  cost  is  the  m^or  cost  of 
most  space  programs,  averaging  72  percent  of  the  total  cost  for  the  29 
programs. 
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Table  III,  1  presents  the  initiation  dates  and  the  clu'uiges  in  launcli  dates  for 
the  29  programs  we  reviewed.  Launch  dates  for  most  progr;uns  liave 
slipped  at  least  1  year,  with  the  Galileo  program  experiencing  the  longest 
slip — 8  years.  The  average  delay  for  the  12  prognuivs  that  have  been 
launched  was  44  months. 


Table  and  Current 

Dates  Initial  Launch 


Fiscal  year 

launch 

Current/actual 

slip 

Program 

initiated 

date 

launch  date* 

(months) 

TSS 

1984 

4/87 

8/92 

64 

XTE 

1990 

10/94 

4/96 

18 

Galileo 

1978 

10/81 

10/89 

96 

AXAF 

1989 

10/95 

4/99 

42 

ATP^ 

1986 

10/91 

10/94 

36 

HST 

1978 

10/83 

4/90 

70 

EUVE 

1984 

10/88 

6/92 

44 

GOES  l-M'' 

1985 

10/89 

10/93 

48 

AFE  (canceled) 

1988 

8/92 

8/96 

48 

GRO 

1981 

10/85 

4/91 

66 

ASRM‘>'‘= 

1989 

10/94 

12/98 

50 

NSCAT 

1985 

10/88 

1/96 

87 

Mars  Observer 

1985 

8/90 

9/92 

25 

OMV  (canceled) 

1987 

8/91 

4/95 

44 

TDRS-7 

1987 

10/91 

10/95 

48 

LANDSAT-D 

1978 

1/81 

7/82 

18 

COSTR:'*  Cluster 

1987 

7/93 

10/95 

27 

SOHO 

10/93 

7/95 

25 

Geotail 

4/92 

7/92 

3 

TRMM 

1991 

1/97 

7/97 

6 

Ulysses 

1979 

2/83 

10/90 

92 

Magellan 

1984 

4/88 

5/89 

13 

FTS  (canceled) 

1988 

1/91 

10/93 

33 

ACTS 

1984 

7/89 

M93 

TOPEX 

1987 

10/91 

8/92 

10 

Freedom* 

1988 

3/94 

4/97 

25 

GGS:**  Polar 

1988 

7/92 

4t94 

21 

Wind 

1/92 

7f93 

18 

UARS 

1982 

10/89 

9/91 

23 

(continued) 
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Initial  Launch 


Fiscal  year 

launch 

Current/actual 

Slip 

Program 

Initiated 

date 

launch  date* 

(monlhs) 

CRAF  (canceled) 

1990 

8/95 

2/96 

6 

Cassini 

1990 

4/96 

10/97 

Endeavour'* 

1987 

1/92 

4. ,'92 

EOS'* 

1991 

10/98 

4/98 

€ 

•Current  launch  dates  are  as  of  NASA's  fiscal  year  1993  budget  requesi  Cuffent  launct;  ariie; ' 
canceled  programs  were  the  latest  dates  prior  to  cancellation 

"Launch  dates  for  ATP,  GOES  l-M,  ASRM,  Endeavour,  and  EOS  arc  for  the  first  la^jnch  i"'  r,  st'  h';; 

"A  current  launch  dale  was  not  estimated  lor  ASRM  at  the  time  of  NASA's  fiscal  year  1993  bud  ji' 
request  because  the  program  was  proposed  lor  termination  Congress  rejected  the  coccsai  lo 
terminate  the  program  and  directed  NASA  to  maintain  a  first  launch  date  of  December  199? 

"COSTR  and  GGS  involve  multiple  missions  and  spacecraft 

•The  fiscal  year  initiated  ar  the  initial  launch  date  for  space  station  E'eedom  were  estapi'Sheo  a' 
the  lime  the  program  begai  the  detailed  design  and  development  phase's,  consister't  w  tn  !■'  c 
timing  of  the  fiscal  year  initialed  and  initial  launch  dales  for  the  other  programs  m  me  tack;  ft"'.'.,,.-, 
provided  an  initial  launch  date  of  March  1992  lo  Congress  m  1984  prior  to  completing  tne 
definition  phase.  The  launch  dales  are  for  the  first  element  launch 
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